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Abstract 



We give a classical confidence belt construction which unifies the treat- 
ment of upper confidence limits for null results and two-sided confidence inter- 
vals for non-null results. The unified treatment solves a problem (apparently 
not previously recognized) that the choice of upper limit or two-sided inter- 
vals leads to intervals which are not confidence intervals if the choice is based 
on the data. We apply the construction to two related problems which have 
recently been a battle-ground between classical and Bayesian statistics: Pois- 
son processes with background, and Gaussian errors with a bounded physical 
region. In contrast with the usual classical construction for upper limits, our 
construction avoids unphysical confidence intervals. In contrast with some 
popular Bayesian intervals, our intervals eliminate conservatism (frequentist 
coverage greater than the stated confidence) in the Gaussian case and reduce 
it to a level dictated by discreteness in the Poisson case. We generalize the 
method in order to apply it to analysis of experiments searching for neutrino 
oscillations. We show that this technique both gives correct coverage and is 
powerful, while other classical techniques that have been used by neutrino 
oscillation search experiments fail one or both of these criteria. 

PACS numbers: 06.20.Dk, 14.60.Pq 
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I. INTRODUCTION 



Classical confidence intervals are the traditional way in which high energy physicists re- 
port errors on results of experiments. Approximate methods of confidence interval construc- 
tion, in particular the likelihood-ratio method, are often used in order to reduce computation. 
When these approximations are invalid, true confidence intervals can be obtained using the 
original (defining) construction of Neyman In recent years, there has been considerable 
dissatisfaction with the usual results of Neyman's construction for upper confidence limits, 
in particular when the result is an unphysical (or empty set) interval. This dissatisfaction led 
the Particle Data Group (PDG) to describe procedures for Bayesian interval construction 
in the troublesome cases: Poisson processes with background, and Gaussian errors with a 
bounded physical region. 

In this paper, we use the freedom inherent in Neyman's construction in a novel way 
to obtain a unified set of classical confidence intervals for setting upper limits and quoting 
two-sided confidence intervals. The new element is a particular choice of ordering, based on 
likelihood ratios, which we substitute for more common choices in Neyman's construction. 
We then obtain confidence intervals which are never unphysical or empty. Thus they remove 
an original motivation for the description of Bayesian intervals by the PDG. 

Moreover, we show below that commonly quoted confidence intervals are wrong more 
than allowed by the stated confidence if (as is typical) one uses the experimental data to 
decide whether to consult confidence interval tables for upper limits or for central confidence 
intervals. In contrast, our unified set of confidence intervals satisfies (by construction) the 
classical criterion of frequentist coverage of the unknown true value. Thus the problem of 
wrong confidence intervals is also solved. 

Our intervals also effectively decouple the calculation of intervals from the test of 
goodness-of-fit, which is desirable but in fact not the case for traditional classical upper 
limit calculations. 

After developing the new intervals for the two prototypical 1-D problems, we generalize 
them for use in the analysis of experiments searching for neutrino oscillations, continuing to 
adhere to the Neyman construction. 

In Sec. H, we review and contrast Bayesian and classical interval construction. In Sec. |T|, 
we review the troublesome cases of Poisson processes with background and Gaussian errors 
with a bounded physical region. We introduce the unifying ordering principle in Sec. 
and apply it to the previously discussed problems. In Sec. 0, we generalize the method for 
use in neutrino oscillation searches, and compare it to other classical methods. Finally, in 
Sec. 0, we introduce an additional quantity helpful in describing experiments which observe 
less background than expected. We conclude in Sec. |V14 

We adopt the following notation: the subscript t on a parameter means the unknown 
true value; the subscript means a particular measured value obtained by an experiment. 
Thus, for example, /i is a parameter whose true value /xj is unknown; no is the particular 
result of an experiment which measures the number of events n. For most of our discussion, 
we use for illustration 90% C.L. confidence intervals on a single parameter /i. The confidence 
level (C.L.) is more generally called a. 
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II. BAYESIAN AND CLASSICAL INTERVAL CONSTRUCTIONS 



A. Bayesian Intervals 

Although our approach is classical, it is worthwhile to review Bayesian intervals since 
we find that misconceptions about classical intervals can have their roots in misinterpreting 
them as Bayesian intervals. For advocacy of Bayesian intervals in high energy physics, see, 
for example, Refs. @J5l- 

Suppose that we wish to make an inference about a parameter /i whose true value fit 
is unknown. Assume that we do this by making a single measurement of an observable x 
such that the probability density function (pdf) for obtaining the value x depends on the 
unknown parameter /i in a known way: we call this pdf P{x\n) [Q. (Note that x need not 
be a measurement of /i, though that is often the just needs to be some observable 

whose pdf depends on /x.) 

Now suppose that the single measurement of x yields the value Xq. One substitutes this 
value of X into P{x\fi) to obtain P(xo|/i), known as the likelihood function, which we denote 
/:(xo|/i). 

The Bayesian deems it sensible to speak of pdf 's for the unknown fif, these pdf 's represent 
degree of belief about fif One makes inferences using the "posterior" pdf, which is the 
conditional pdf P(/it |xo) for the unknown fit, given the result Xq of the measurement. It is 
related to C by applying Bayes's Theorem. Bayes's Theorem in classical probability says that 
the probability that an element is in both sets A and B is P{A\B) P{B) = P{B\A) P{A). 
Bayesians apply this to pdf's for fit, obtaining 

Pifitlxo) = Cixolfit) P{fit)/P{xo). (2.1) 

Typically the denominator is just a normalization constant, so the major issue is what to 
use for P{fit), which is called the "prior" pdf. For the moment we assume that one has the 
prior pdf, so that then one has the posterior pdf. 

A Bayesian interval [fii, fi2] corresponding to a confidence level a can be constructed 
from the posterior pdf by requiring 

/ P{fit\xo)dfit = a. (2.2) 

These intervals are more properly called " credible intervals" , although the phrase "Bayesian 
confidence intervals" is also used Note that there is freedom in the choice of fii depending 
on whether one desires an upper limit, lower limit, central interval, etc. 

We believe that for making decisions, this Bayesian description of inference is probably 
how many scientists do (and should) think, and that the prior pdf one uses is typically the 
subjective prior. One person's subjective prior incorporates all of that person's personal 
beliefs as well as the results of previous experiments. Thus, values of fi which contradict 
well-founded theoretical thinking are (properly) given a low prior 

There have been long-standing attempts to take the subjectivity out of the prior pdf, in 
order to have an "objective" Bayesian interval. One attempts to define a prior pdf which 
represents prior ignorance, or which is "non-informative" . The naive choice of uniform prior 
is not well-defined for a continuous variable, since one must specify in what metric the 
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prior is uniform; this is just as hard as specifying the functional form in a particular given 
metric. For a parameter /i which is restricted to [0,cx)], a common non-informative prior 
in the statistics literature ||,^ is = 1//^*, which corresponds to a uniform prior for 

InyLif. An alternative ||TO| . [TT[] for the Poisson mean is P{^t) = In contrast, the PDG 

recommendation is equivalent to using a prior which is uniform in fif This recommendation 
has no basis that we know of in Bayesian theory. It is based on the desire to have intervals 
which are conservative (see below) and somewhat robust from a frequentist (anti-Bayesian) 
point of view. 

In our view, the attempt to find a non-informative prior within Bayesian inference is 
misguided. The real power of Bayesian inference lies in its ability to incorporate "informa- 
tive" prior information, not "ignorance" . The interpretation of Bayesian intervals based on 
uniform priors is vague at best, since they may bear no relation either to subjective Bayesian 
intervals of a typical scientist, or to classical confidence intervals which are probability state- 
ments based only on P(x|/i). 



B. Classical Confidence Intervals 

Neyman's original "confidence intervals" completely avoid the concept of pdf's in fit, 
and hence have no troublesome prior. They are limited to statements derived from P(a;|/i); 
in our experience this can lead to misinterpretations by those who mistakenly take them 
to be statements about P{fit\xo). We believe that, compared to Bayesian intervals with an 
"objective prior" , confidence intervals provide the preferred option for publishing numerical 
results of an experiment in an objective way. However, it is critical not to interpret them as 
Bayesian intervals, i.e., as statements about P{fit\xo)- Rather, a confidence interval [fii,fi2] 
is a member of a set, such that the set has the property that 

P{fi G = «• (2-3) 



Here /ii and /i2 are functions of the measured x, and Eq. p.3| refers to the varying confidence 
intervals [/ii,/i2] from an ensemble of experiments with fixed ^. For a set of confidence 
intervals, Eq. |2.3| is true for every allowed fi. Thus, in particular, the intervals contain the 
fixed unknown fit in a fraction a of experiments. This is entirely different from the Bayesian 
statement that the degree of belief that /if is in [/ii,/X2] is a. 

If Eq. ( p73|) is satisfied, then one says that the intervals "cover" fi at the stated confidence, 
or equivalently, that the set of intervals has the correct "coverage" . If there is any value of 
fi for which P(/i G [fii, (12]) < a, then we say that the intervals "undercover" for that fi. 
Significant undercoverage for any /x is a serious flaw. If there is any value of /i for which 
P(/i G [/ii,/i2]) > a, then we say that the intervals "overcover" for that /i. A set of intervals 
is called "conservative" if it overcovers for some values of fi while undercovering for no values 
of /i. Conservatism, while not generally considered to be as serious a flaw as undercoverage, 
comes with a price: loss of power in rejecting false hypotheses. 

Our confidence intervals require the full power of Neyman's construction, which for one 
measured quantity and one unknown parameter is called the method of "confidence belts" 
r^,[T2|. Figure |I] illustrates such a construction on a graph of the parameter /i vs. the 



measured quantity x. For each value of /x, one examines P{x\fi) along the horizontal line 
through /i. One selects an interval [xi, X2] which is a subset of this line such that 



4 



P{x E [xi,X2] l/i) = a. 



(2.4) 



Such intervals are drawn as horizontal line segments on Fig. |T], at representative values of 
/i. We refer to the interval [xi,X2] as the "acceptance region" or the "acceptance interval" 
for that /i. In order to specify uniquely the acceptance region, one must choose auxiliary 
criteria. One has total freedom to make this choice, if the choice is not influenced by the 
data Xo- The most common choices are: 

P{x < xilfi) = 1 - a, (2.5) 

which leads to "upper confidence hmits" (which satisfy P{fi > jj,2) = I — a); and 

P{x < xi\n) = P{x > X2\fi) = (1 - a)/2, (2.6) 

which leads to "central confidence intervals" (which satisfy P{fi < fii) = P(/i > /i2) = 
(1 — a)/2). For these choices, the full confidence belt construction is rarely mentioned, since 
a simpler explanation suffices when one specifies P{x < Xi\^) and P{x > X2|/i) separately. 
For more complicated choices which still satisfy the more general specification of Eq. ( ^.4| ), 
an ordering principle is needed to specify which x's to include in the acceptance region. We 
give our ordering principle in Sec. |V|. 

The construction is complete when horizontal acceptance intervals are drawn for each 
value of fi. Upon performing an experiment to measure x and obtaining the value xq, one 
draws a vertical line (shown dashed in Fig. |l|) through xq on the horizontal axis. The 
confidence interval is the union of all values of /i for which the corresponding horizontal 
interval is intercepted by the vertical line; typically this is a simply connected interval 
[/ii,/i2]. When displayed in texts, typically only the endpoints of the intervals are drawn, 
which collectively form the "confidence belt" . 

By construction, Eq. (|2.3|) is satisfied for all fi; Hence it is satisfied for fit, whose value 
is fixed but unknown. 



III. EXAMPLES OF CLASSICAL INTERVALS 

A. Gaussian with Boundary at Origin 

Figures Q and ^ show standard confidence belts (for upper limits and central intervals, 
respectively) when the observable x is simply the measured value of n in an experiment with 
a Gaussian resolution function with known fixed rms deviation a, set here to unity. I.e., 

Pi^lf^) = 4= exp(-(x - fiY/2). (3.1) 
V 27r 

We consider the interesting case where only non-negative values for fi are physically allowed 
(for example, if is a mass). Thus, the graph does not exist for ^ < 0. 

Although these are standard graphs, we believe that common use of them is not en- 



tirely proper. Fig. 0, constructed using Eq. p75|, is appropriate for experiments when it 



is determined before performing the experiment that an upper limit will be published. Fig. 
^, constructed using Eq. p.6|, is appropriate for experiments when it is determined before 
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performing the experiment that a central confidence interval will be published. However, it 
may be deemed more sensible to decide, based on the results of the experiment, whether to 
pubhsh an upper hmit or a central confidence interval. 

Let us suppose, for example, that Physicist X takes the following attitude in an experi- 
ment designed to measure a small quantity: "If the result x is less then 3cr, I will state an 
upper limit from the standard tables. If the result is greater than 3a, I will state a central 
confidence interval from the standard tables." We call this policy "fiip-fiopping" based on 
the data. Furthermore, Physicist X may say, "If my measured value of a physically positive 
quantity is negative, I will pretend that I measured zero when quoting a confidence interval" , 
which introduces some conservatism. 

We can examine the effect of such a fiip-fiopping policy by displaying it in confidence- 
belt form as shown in Fig. |^. For each value of measured x, we draw at that x the vertical 
segment [/ii,/i2] that Physicist X will quote as a confidence interval. Then we can examine 
this collection of vertical confidence intervals to see what horizontal acceptance intervals it 
implies. For example, for /i = 2.0, the acceptance interval has Xi = 2 — 1.28 and X2 = 2+1.64. 
This interval only contains 85% of the probability P{x\fi). Thus Eq. ( p.4| ) is not satisfied. 
Physicists X's intervals undercover for a significant range of fi: they are not confidence 
intervals or conservative confidence intervals. 

Both Figs. and 1^ are confidence intervals when used appropriately, i.e., without fiip- 
fiopping. However, the result is unsatisfying when one measures, for example, x = —1.8. 
In that case, one draws the vertical line as directed and finds that the confidence interval 
is the empty set! (An alternative way of expressing this situation is to allow non-physical 
/i's when constructing the confidence belt, and then to say that the confidence interval is 
entirely in the non-physical region. This requires knowing P{x\fi) for non-physical fi, which 
can raise conceptual difficulties.) When this situation arises, one knows that one is in the 
"wrong" 10% of the ensemble quoting 90% CL. intervals. One can go ahead and quote the 
wrong result, and the ensemble of intervals will have the proper coverage. But this is not 
very comforting. 

Both problems of the previous two paragraphs are solved by the ordering principle which 
we give in Sec. fV]. 



B. Poisson with Background 



Figures ^ and ^ show standard [0,0] confidence belts for a Poisson process when the 
observable x is the total number of observed events n, consisting of signal events with mean 
/i and background events with known mean b. I.e., 

P{n\fi) = + 6)"exp(-(^ + b))/n\ (3.2) 

In these figures, we use for illustration the case where b = 3.0. 

Since n is an integer, Eq. ( p.3| ) can only be approximately satisfied. By convention dating 
to the 1930 's, one strictly avoids undercoverage and replaces the equality in Eq. ( p.3|) with 
">" . Thus the intervals overcover, and are conservative. 

Although the word "conservative" in this context may be viewed by some as desirable, 
in fact it is an undesirable property of a set of confidence intervals. Ideal intervals cover 
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the unknown true value at exactly the stated confidence: 90% CL. intervals should fail to 
contain the true value 10% of the time. If one desires intervals which cover more than 90% 
of the time, the solution is not to add conservatism to the intervals, but rather to choose a 
higher confidence level. The discreteness of n in the Poisson problem leads unavoidably to 
some conservatism, but this is unfortunate, not a virtue. 

The Poisson intervals in Figs. |^ and ^ suffer from the same problems as the Gaussian 
intervals. First, if Physicist X uses the data to decide whether to use Fig. |^ or Fig. |^, 
then the resulting hybrid set can undercover. Second, there is a well-known problem if, for 
example, b = 3.0 and no events are observed. In that case, the confidence interval is again 
the empty set. These problems are solved by the ordering principle given in Sec. |V|. 

For this Poisson case, there is an alternative set of intervals, given by Crow and Gardner 



15| , which is instructive because it requires the full Neyman construction. In constructing 
these intervals, one minimizes the horizontal length of the acceptance region [rii, ^2] at each 
value of /i. Since n is a discrete variable, the concept of length in the horizontal direction 
can be well-defined as the number of discrete points. Said another way, the points in the 
acceptance interval at each fi are chosen in order of decreasing P{n\fi), until the until the 
sum of P(n|/x) meets or exceeds the desired C.L. (There are other technical details in the 
original paper.) The Crow-Gardner intervals are instructive because neither Eq. ( |2.5| ) nor 
Eq. ( p.6| ) is satisfied, even as a conservative inequality. (Recall that x is identified with n in 
this section.) For a = 0.9, P{n < ni|/i) varies between 0.018 and 0.089, and P{n > n2|/i) 
varies between 0.011 and 0.078, in a manner dictated by the Neyman construction so that 
always P{n G [ni,n2] |/i) > 0.9. Like Crow and Gardner, we use Neyman's construction, 
but with a different ordering for choosing the points in the acceptance interval. 



IV. NEW INTERVALS FROM AN ORDERING PRINCIPLE BASED ON 

LIKELIHOOD RATIOS 



A. Poisson with Background 



We begin with a numerical example which occurs in the construction of confidence belts 
for a Poisson process with background. The construction proceeds in the manner of Fig. |l|, 
where the measurement x in Fig. now corresponds to the measured total number of events 
n. 

Let the known mean background he b = 3.0, and consider the construction of the hori- 
zontal acceptance interval at signal mean /i = 0.5. Then P{n\fi) is given by Eq. ( |3.2| ), and 
is given in second column of Table |. 

Now consider, for example, n = 0. For the assumed 6 = 3., the probability of obtaining 
events is 0.03 if /i = 0.5, which is quite low on an absolute scale. However, it is not so 
low when compared to the probability (0.05) of obtaining events with 6 = 3. and n = 0.0, 
which is the alternate hypothesis with the greatest likelihood. A ratio of likelihoods, in this 
case 0.03/0.05, is what we use as our ordering principle when selecting those values of n to 
place in the acceptance interval. 

That is, for each n, we let /ibest be that value of mean signal /i which maximizes P(n|/i); 
we require //best to be physically allowed, i.e., non- negative in this case. Then /ibest = 
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max(0,n — b), and is given in the third column of Table |. We then compute P(n|/ibest), 
which is given in the fourth column. The fifth column contains the ratio, 

i? = P(n|/x)/P(n|/ibest), (4.1) 

and is the quantity on which our ordering principle is based. R is a ratio of two likelihoods: 
the likelihood of obtaining n given the actual mean fi, and the likelihood of obtaining n 
given the best-fit physically allowed mean. Values of n are added to the acceptance region 
for a given /i in decreasing order of R, until the sum of P{n\fi) meets or exceeds the desired 
CL. This ordering, for values of n necessary to obtain total probability of 90%, is shown 
in the column labeled "rank". Thus, the acceptance region for fi = 0.5 (analogous to a 
horizontal line segment in Figure 1), is the interval n = [0, 6]. Due to the discreteness of n, 
the acceptance region contains more summed probability than 90%; this is unavoidable no 
matter what the ordering principle, and leads to confidence intervals which are conservative. 

For comparison, in the column of Table | labeled "U.L.", we place check marks at the 
values of n which are in the acceptance region of standard 90% CL. upper limits for this 
example; and in the column labeled "central" , we place check marks at the values of n which 
are in the acceptance region of standard 90% CL central confidence intervals. 

The construction proceeds by finding the acceptance region for all values of /i, for the 
given value of b. With a computer, we perform the construction on a grid of discrete values 
of fi, in the interval [0, 50] in steps of 0.005. This suffices for the precision desired (0.01) in 
endpoints of confidence intervals. We find that a mild pathology arises as a result of the 
fact that the observable n is discrete. When the vertical dashed line is drawn at some Uq (in 
analogy with in Fig. |l|), it can happen that the set of intersected horizontal line segments is 
not simply connected. When this occurs we naturally take the confidence interval to have 
fj,i corresponding to the bottom-most segment intersected, and to have /i2 corresponding to 
the top-most segment intersected. 

We then repeat the construction for a selection of fixed values of b. We find an additional 
mild pathology, again caused by the discreteness in n: when we compare the results for 
different values of b for fixed no, the upper endpoint fi2 is not always a decreasing function 
of b, as would be expected. When this happens, we force the function to be non-increasing, 
by lengthening selected confidence intervals as necessary. We have investigated this behavior, 
and compensated for it, over a fine grid of b in the range [0, 25] in increments of 0.001 (with 
some additional searching to even finer precision). 

Our compensation for the two pathologies mentioned in the previous paragraphs adds 
slightly to our intervals' conservatism, which however remains dominated by the unavoidable 
effects due to the discreteness in n. 

The confidence belts resulting from our construction are shown in Fig. [7], which may 
be compared with Figs. ^ and ^. At large n, Fig. |^ is similar to Fig. ^ the background 
is effectively subtracted without constraint, and our ordering principle produces two-sided 
intervals which are approximately central intervals. At small n, the confidence intervals from 
Fig. automatically become upper limits on /x; i.e., the lower endpoint fii is for n < 4 
in this case. Thus, fiip-fiopping between Figs. ^ and ^ is replaced by one coherent set of 
confidence intervals, (and no interval is the empty set). 

Tables Ujl^ give our confidence intervals [/ii,/i2] for the signal mean fi for the most 
commonly used confidence levels, namely 68.27% (sometimes called 1-a intervals by analogy 
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with Gaussian intervals), 90%, 95%, and 99%. Values in italics indicate results which must 
be taken with particular caution, since the probability of obtaining the number of events 
observed or fewer is less than 1%, even if /i = 0. (See Sec. |1V C| below.) 

Figure |^ shows, for n = through n = 10, the value of fi2 as a function of b, for 
90% CL. The small horizontal sections in the curves are the result of the mild pathology 
mentioned above, in which the original curves make a small dip, which we have eliminated. 
Dashed portions in the lower right indicate results which must be taken with particular 
caution, corresponding to the italicized values in the tables. Dotted portions on the upper 
left indicate regions where Hi is non-zero. These corresponding values of fii are shown in 
Fig. |. 

Figure |^ can be compared with the Bayesian calculation in Fig. 28.8 of Ref. P] which 
uses a uniform prior for fif A noticeable difference is that our curve for n = decreases 
as a function of b, while the result of the Bayesian calculation stays constant (at 2.3). The 
decreasing limit in our case reflects the fact that P(no|/i) decreases as b increases. We find 
that objections to this behavior are typically based on a misplaced Bayesian interpretation 
of classical intervals, namely the attempt to interpret them as statements about P(yUt|no). 



B. Gaussian with Boundary at Origin 

It is straightforward to apply our ordering principle to the other troublesome example 
of Sec. Ill, the case of a Gaussian resolution function (Eq. |3.1| ) for /i, when /i is physically 



bounded to non-negative values. In analogy with the Poisson case, for a particular x, 
we let /ibest be the physically allowed value of ^ for which P(x|/i) is maximum. Then 
/Xbest = max(0,x), and 

n/ I \ \ ^/V^, X>0 



We then compute R in analogy to Eq. [4.1|, using Eqs. |3.1| and 



^ P{x\fi) ^ r exp(-(x - /i)V2), X > 
P(x|/ibcst) \ exp(x/i - /iV2), x<0. 

During our Neyman construction of confidence intervals, R determines the order in which 
values of x are added to the acceptance region at a particular value of fi. In practice, this 
means that for a given value of /i, one finds the interval [xi,X2] such that R{xi) = R{x2) 
and 

P{x\^)dx = a. (4.4) 

We solve for xi and X2 numerically to the desired precision, for each in a grid with 
0.001 spacing. With the acceptance regions all constructed, we then read off the confidence 
intervals [/ii,yU2] for each xq as in Fig. 0. 

Table ^ contains the results for representative measured values and confidence levels. 
Figure ITUI shows the confidence belt for 90% C.L. 



It is instructive to compare Fig. ^ with Fig. |^. At large x, the confidence intervals 
[yUi,/i2] are the same in both plots, since that is far away from the constraining boundary. 
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Below X = 1.28, the lower endpoint of the new confidence intervals is zero, so that there is 
automatically a transition from two-sided confidence intervals to an upper confidence limit 
given by fi2- The point of this transition is fixed by the calculation of the acceptance interval 
for /i = 0; the solution has Xi = — oo, and so Eq. ^]4|is satisfied by X2 = 1.28 when a = 90%. 
Of course, one is not obligated to claim a non-null discovery just because the 90% CL. 
confidence interval does not contain zero. With a proper understanding of what confidence 
intervals are (Sec. [11 B| ), one realizes that they do not indicate degree of belief. 

Our 90% CL. upper limit at a; = is = 1-64, which, interestingly, is the standard 
95% CL. upper limit, rather than = 1.28, which is the standard 90% CL. upper limit. 
The departure from the standard 90% CL. upper limits refiects the fact, mentioned above, 
that they provide frequentist coverage only when the decision to quote an upper limit is not 
based on the data. Our method repairs the undercoverage caused by fiip-fiopping (Fig.||), 
with a necessary cost in loosening the upper limits around x = 0. 

As X decreases, the upper limits from our method decrease, asymptotically going as l/\x\ 
for large negative x. As in the Poisson case, particular caution is necessary when interpreting 
limits obtained from measured values of x which are unlikely for all physical fi. 



C. Decoupling of Goodness-of-Fit CL. from the Confidence Interval C.L. 

An advantage of our intervals compared to the standard classical intervals is that ours 
effectively decouple the confidence level used for a goodness-of-fit test from the confidence 
level used for confidence interval construction. 

To elaborate, let us first recall the procedure used in a standard "easy" fit (free from 
constraints, background, etc.), for example the fit of a one-parameter curve to a set of points 
with Gaussian error bars. One examines the between the data and the fitted curve, as 
function of the fit parameter. The value of at its minimum is used to determine goodness- 
of-fit: using standard tables, one can convert this value to a goodness-of-fit confidence level 
which tells one the quality of the fit. A very poor fit means that the information on the 
fitted parameter is suspect: the experimental uncertainties may not be assessed properly, 
the functional form of the parametrized curve may be wrong, or, in the most general terms, 
the hypotheses being considered may not be the relevant ones. 

If the value of the minimum is considered acceptable, then one examines the shape of 

(as a function of the fit parameter) near its minimum, in order to obtain an (approximate) 
confidence interval for the fit parameter at any desired confidence level. This procedure is 
powerful because it does not permit random fiuctuations that favor no particular parameter 
value to infiuence the confidence interval. The two confidence levels invoked in this example 
are then independent; for example, one may require that the goodness-of-fit CL. be in the 
top 99% in order to consider the fit to be acceptable, while quoting a 68% CL. confidence 
interval for the fitted parameter. 



The problems with the standard classical intervals in Sec. |T| can be viewed from the 
point of view that they effectively constrain the CL. used for goodness-of-fit to be related 
to that used for the confidence interval. In both the Gaussian and the Poisson upper limit 
examples, consider, for example, 90% as the CL. for upper limits; the confidence interval 
is the empty set (or outside the physical region, some prefer to say) some fraction of the 
time which is determined by this choice of CL. For example, if the true mean is zero in 



10 



the constrained Gaussian problem, then the empty set is obtained 10% of the time from 
Fig. ^; if the true mean is zero in the Poisson-with-background problem, the empty set can 
be obtained up to 10% of the time from confidence belts such as Fig. |^ (depending on the 
mean background b, and on how discreteness affects the intervals for that b.) An empty-set 
confidence interval has the same effect as failing a goodness-of-fit test: no useful confidence 
interval is inferred. With the standard confidence intervals, one is forced to use a specific 
CL. for this effective goodness-of-fit test, coupled to the CL. used for interval construction. 
We believe this to be most undesirable, and at the heart of the community's dissatisfaction 
with the standard intervals. 

In contrast, our construction always provides a confidence interval at the desired con- 
fidence level (with of course some conservatism for the discrete problems). Independently, 
one can calculate the analog of goodness-of-fit, and decide whether or not to consider the 
data or model (including mean expected background) to be invalid. This issue arises in the 
case when an upper limit is quoted; i.e., the confidence interval is [0,/i2]- 

In the constrained Gaussian case, one might have data Xq = —2.0 and hence 90% C.L. 
confidence interval [0, 0.4] from Tab. ^. The natural analog for goodness-of-fit is the prob- 
ability to obtain x < xq under the best-fit assumption of yU = 0. 

In the Poisson-with-background case, one might have data uq = 1 for 6 = 3, and hence 
90% C.L. confidence interval [0, 1.88] from Tab. 0. The natural analog for goodness-of-fit 
is the probability to obtain n < uq under the best-fit assumption of yU = 0. 

As noted above, in Fig. |]we follow the practice of the PDG [0] by indicating with dashed 
lines those regions where the goodness-of-fit criterion is less than 1%. In Tables the 
corresponding intervals are italicized. 

In summary, because our intervals decouple of the confidence level used for a goodness- 
of-fit test from the confidence level used for confidence interval construction, one is free to 
choose them independently, at whatever level desired. 

V. APPLICATION TO NEUTRINO OSCILLATION SEARCHES 
A. The Experimental Problem 

Experimental searches for neutrino oscillations provide an example of the application of 
this technique to a multidimensional problem. Indeed it is just this problem that originally 
focused our attention on this investigation. 

Experiments of this type search for a transformation of one species of neutrino into 
another. To be concrete, we assume that the experiment is to search for transformations 
between muon type neutrinos, z/^, and electron type neutrinos, z/g, and that the influence of 
other types of neutrinos can be ignored. We hypothesize that the weak eigenstates {un) and 
l^e) are linear superpositions of two mass eigenstates, |z/i) and |z/2), 

l^^e) = I'^i) cos6' + lz/2) sin6' (5.1) 

and 

I'^^t) = |^'2) cos^^ — sin6', (5.2) 
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and that the mass eigenvalues for and lz/2) are mi and m2, respectively. Quantum 
mechanics dictates that the probability of such a transformation is given by the formula 

00 



P{v, v^) = sin2(2^) sin^ (h^I^!!^^ ^ (5.3) 

where P is the probability for a z/^ to transform into a z/e, L is the distance in km between 
the creation of the neutrino from meson decay and its interaction in the detector, E is the 
neutrino energy in GeV, and Am^ = — ml\ in (eV/c^)^. 

The result of such an experiment is typically represented as a two-dimensional confidence 
region in the plane of the two unknown physical parameters, 6, the rotation angle between 
the weak and mass eigenstates, and Am^, the (positive) difference between the squares of 
the neutrino masses. Traditionally, sin^(26') is plotted along the horizontal axis and Am^ is 



plotted along the vertical axis. An example of such a plot is shown in Fig. [11], based on a 
toy model that we develop below. In this example, no evidence for oscillations is seen and 
the confidence region is set as the area to the left of the curve in this figure. 



B. The Proposed Technique for Determining Confidence Regions 

The problem of setting the confidence region for a neutrino oscillation search experiment 
often shares all of the difficulties discussed in the previous sections. The variable sin^(20) 
is clearly bounded by zero and one. Values outside this region can have no possible inter- 
pretation within the theoretical framework that defines the unknown physical parameters. 
Yet consider an experiment searching in a region of Am^ in which oscillations either do not 
exist or are well below the sensitivity of the experiment. Such an experiment is typically 
searching for a small signal of excess Uf, interactions in a potentially large background of Uf, 
interactions from conventional sources and misidentified i/^ interactions. Thus, it is equally 
likely to have a best fit to a negative value of sin^(26') as to a positive one, provided that 
the fit to Eq. ( p. 3D is unconstrained. 

Typically, the experimental measurement consists of counting the number of events in an 
arbitrary number of bins |T^ in the observed energy of the neutrino and possibly other mea- 
sured variables, such as the location of the interaction in the detector. Thus, the measured 
data consist of a set iV = {ui}, together with an assumed known mean expected background 
B = {bi} and a calculated expected oscillation contribution T = sin^(2^), Am^}. 

To construct the confidence region, the experimenter must choose an ordering principle 
to decide which of the large number of possible N sets should be included in the acceptance 
region for each point on the sin^(26') — Am^ plane. We suggest the ordering principle identical 
to the one suggested in Sec 0, namely the ratio of the probabilities 

_P(]V^ (54) 

where Tbest(sin^(26')bcst, Am^^gJ gives the highest probability for P{N\T) for the physically 
allowed values of sin^(20) and Am^. 
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In the Gaussian regime, = ~21n(P), so this approach is equivalent to using the 
difference in between T and Tbest, i-e., 



{rii - hi - HiY (rii - hi- /ibest. 



a? a? 



(5.5) 



likehhood function, [1 



where Uj is the Gaussian error. We actually recommend an alternative form based on the 

(5.6) 



j L \ Hi -\- Oi 



since it can be used in all cases. 

To demonstrate how this works in practice, and how it compares to alternative approaches 
that have been used, we consider a toy model of a typical neutrino oscillation experiment. 
The toy model is defined by the following parameters: Mesons are assumed to decay to 
neutrinos uniformly in a region 600 m to 1000 m from the detector. The expected background 
from conventional interactions and misidentified z/^ interactions is assumed to be 100 
events in each of 5 energy bins which span the region from 10 to 60 GeV. We assume that 
the flux is such that if P{i^^ — ^ i^e) = 0.01 averaged over any bin, then that bin would 
have an expected additional contribution of 100 events due to z/^ — oscillations. 

The acceptance region for each point in the sin^(2^) — Am^ plane is calculated by per- 
forming a Monte Carlo simulation of the results of a large number of experiments for the 
given set of unknown physical parameters and the known neutrino flux of the actual ex- 
periment. For each experiment, Ax^ is calculated according to the prescription of either 
Eq. |5.5| or ^.6[ The single number that is needed for each point in the sin^(20) — Am^ plane 
is Ax^(sin^(26'), Am^), such that a of the simulated experiments have Ax^ < Axl- After 
the data are analyzed, Ax^ for the data and each point in the sin^(20) — Am^ plane, i.e. 
Ax^(A^| sin^(26'), Am^), is compared to Axl and the acceptance region is all points such 
that 

Ax^(A^| sin^(2^), Am^) < Ax^(sin2(2^), Am^). (5.7) 



Figure O is an example of the result of a calculation for a random experiment in the toy 
model for which there were no oscillations, i.e., for sin^(26') = 0. 

One might naively expect that Axl = 4.61, the 90% C.L. value for a distribution with 
two degrees of freedom. For the toy model, it actually varies from about 2.4 to 6.6 across 
the sin^(20) — Am^ plane. The deviation from 4.61 is caused by at least three effects: 

1. Proximity to the unphysical region. Points close to the unphysical region occasionally 
have best fits in the unphysical region. Since our algorithm restricts fits to the physical 
region, these fits give a lower Ax^ than unrestricted fits. 

2. Sinusoidal nature of the oscillation function. The x^ distribution assumes a Gaussian 
probability density function, but the oscillation probability function is sinusoidal. For 
high values of Am^ fluctuations can cause a global minimum in a "wrong" trough of 
the function, increasing the value of Ax^ from what it would be if there were only one 
trough. 
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3. One-dimensional regions. In some regions of the plane, the probability distribution 
function becomes one rather than two dimensional. For example, at very low values 
of Am^ the only relevant quantity is the number of events in the lowest energy bin, 
since the oscillation probability, Eq. ( |5.3|) , is proportional to 1/ E"^ for sufficiently low 
Am'^. Fluctuations in higher energy bins do not lead to any physical interpretation, 
and thus cancel in the calculation of Ax^. In these regions, tends to lower values 
than normal. 

C. Comparison to Alternative Classical Methods 

Most papers reporting the results of neutrino oscillation searches have not been explicit 
enough for us to determine exactly how the confidence regions were set. However, we can 
imagine three classical methods that either have or could have been used. We refer to these 
as the Raster Scan, the Flip-Flop Raster Scan, and the Global Scan. All of them have the 
advantage that a Gaussian approximation is made so that a full Neyman construction of the 
confidence region is not necessary. 

1. The Raster Scan: For each value of Am^, a best fit is made for sin^(26'). At each Am^, 

is calculated as a function of sin^(2^), and the 1-D confidence interval in sin^(2^) at 
that Am^ is taken to be all points that have a within 2.71 of the minimum value. 
(2.71 is the two-sided 90% C.L. for a distribution with one degree of freedom.) The 
confidence region in the (sin^(2^), Am^) plane is then the union of all these intervals. 

2. The Flip-Flop Raster Scan: Similar to the Raster Scan except that a decision to use 
a one-sided upper limit or a two-sided interval is made based on the data. If there is 
a signal with significance greater than three standard deviations, the Raster Scan is 
used. If not, an upper limit is set by a raster scan using the one-sided 90% C.L. Ax^ 
value of 1.64. 

3. The Global Scan: A best fit is made to both sin^(2^) and Am^, and the confidence 
region is given as all points that have a within 4.61 of the minimum value. (As 
mentioned above, 4.61 is the two-sided 90% C.L. for a x^ distribution with two degrees 
of freedom.) 

In all three cases, we assume that there is no restriction that the best fit be in the physical 
region. This is because the method of using a fixed Ax^ depends on the reference x^ being 
the minimum of a parabolic x^ distribution. Any attempt to restrict the minimum to the 
physical region automatically gives improper coverage. Thus, all three of these methods 
suffer from the possibility that they could either rule out the entire physical plane, or give 
limits which are not characteristic of the sensitivity of the experiment. 

We have used the toy model to study the coverage of each of these techniques. The 
Raster Scan gives exact coverage. However, it is not a powerful technique in that it cannot 
distinguish a likely value of Am^ from an unlikely one, since it works at fixed Am^. This is 
best illustrated in the case in which a positive signal is found. Figure |12| shows the confidence 
regions for both the Raster Scan and our proposed technique for a sample case for which 
Amj = 40 {eV/c^Y and sin^{29t) = 0.006. Both techniques provide exact coverage, but the 
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proposed technique isolates the signal, with one ghost region, while the Raster Scan does 
not. 

Since the Raster Scan gives exact coverage, it will not surprise the reader to learn that 
the Flip-Flop Raster Scan undercovers for the reasons given in Sec. Figure |l^ shows the 
region of significant undercoverage (greater than 1%) for the Flip-Flop Raster Scan. The 
coverage drops as low as 85%, as is to be expected from the discussion in Sec. |T|. To set 
the scale, a quantity we call the "sensitivity" is also shown in this figure. The sensitivity 
is defined as the average upper limit one would get from an ensemble of experiments with 
the expected background and no true signal. We discuss the use of this quantity further in 
Sec. 0. 

Unlike the Raster Scan and Flip-Flop Raster Scan, the Global Scan is a powerful tech- 
nique. However, it suffers from not giving proper coverage for the reasons enumerated at 
the end of the previous subsection (numbers 2 and 3). It has both regions of undercoverage 
and overcoverage, as shown in Fig. |T^. The coverage varies across the plane from about 76% 
to 94%. 

Table ^ summarizes the properties of the proposed technique and the three alternative 
techniques that we have considered. 



VI. THE PROBLEM OF FEWER EVENTS THAN EXPECTED BACKGROUND 

We started this investigation to solve the problem in classical statistics in which an 
experiment which measures significantly fewer events than are expected from backgrounds 
will report a meaningless or unphysical result. While we have solved that problem, our 
solution still yields results that are bothersome to some in that an experiment that measures 
fewer events than expected from backgrounds will report a lower upper limit than an identical 
experiment that measures a number of events equal to that expected from background. This 
seems particularly troublesome in the case in which the experiment has no observed events. 
Why should an experiment claim credit for expected backgrounds, when it is clear, in that 
particular experiment, there were none? Or why should a well designed experiment which 
has no background and observes no events be forced to report a higher upper limit than a 
less well designed experiment which expects backgrounds, but, by chance, observes none? 

The origin of these concerns lies in the natural tendency to want to interpret these 
results as the probability P{fit\xo) of a hypothesis given data, rather than what they are 
really related to, namely the probability P{xQ\fi) of obtaining data given a hypothesis. It 
is the former that a scientist may want to know in order to make a decision, but the latter 
which classical confidence intervals relate to. As we discussed in Sec. |11 A|, scientists may 



make Bayesian inferences of P{iit\xo) based on experimental results combined with their 
personal, subjective prior probability distribution function. It is thus incumbent on the 
experimenter to provide information that will assist in this assessment. 

Our suggestion for doing this is that in cases in which the measurement is less than the 
estimated background, the experiment report both the upper limit and the "sensitivity" of 
the experiment, where the "sensitivity" is defined as the average upper limit that would be 
obtained by an ensemble of experiments with the expected background and no true signal. 
Table pCII| gives these values, for the case of a measurement of a Poisson variable. 
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Thus, an experiment that measures 2 events and has an expected background of 3.5 
events would report a 90% C.L. upper hmit of 2.7 events (from Tab. but a sensitivity 
of 4.6 events (from Tab. pClJ| ). 

Figure [T^ represents a common occurrence for a neutrino oscillation search experiment. 
It is a repeat of Fig. [11], an example of the toy model in which sin^(2^) = 0, but with the 
sensitivity shown by a dashed line. The behavior is typical of what one would expect. Due to 
random fluctuations, the upper limit is greater than the sensitivity for some values of Am^ 
and less than others. In this case, it is due to fluctuations, but in an actual experiment, it 
could also be due to the presence of a signal around or below the experiment's sensitivity 
at some value Am^, making other values of Am^ less likely. Again, for cases in which a 
significant portion of the upper limit curve is below the sensitivity of the experiment, we 
suggest that the sensitivity curve be displayed as well as the upper limit. 



VII. CONCLUSION 

The construction described in this paper strictly adheres to the Neyman method [|T|, 
as applied to discrete distributions since the 1930 's |ll3Hl5[l. Thus, the resulting confidence 
intervals are firmly grounded in classical statistics theory. What is new is the particular 
choice of ordering we make within the freedom inherent in Neyman's method. This choice, 
described in Sec. yields intervals which automatically change over from upper limits to 
two-sided intervals as the "signal" becomes more statistically significant. This eliminates 
undercoverage caused by basing this choice on the data ("flip-flopping"). Our tables give 
classical confidence intervals for the two common problems for which the PDG has described 
Bayesian solutions incorporating a (questionable) uniform prior for a bounded variable: 
Poisson processes with background, and Gaussian errors with a bounded physical region. 
This introduction of Bayesian methods was at least partly motivated by problems with the 
traditional classical intervals (non-physical or empty-set intervals, and coupling of goodness- 
of-fit C.L. with confidence interval C.L.) which our new intervals solve. Thus, there should 
be renewed discussion of the appropiateness of Bayesian intervals for reporting experimental 
measurements in an objective way. 

The new ordering principle can be applied quite generally. We have developed the appli- 
cation to neutrino oscillation searches, where the confidence region can have a particularly 
complicated stucture due to physical constraints and multiple local minima in the pdf's. 

Finally, we certainly agree that no matter how one constructs an interval, it is important 
to publish relevant ingredients to the calculation so that the reader (and the PDG) can 
(at least approximately) perform alternative calculations or combine the result with other 
experiments [jl9[. In the Gaussian case, the ingredients are the measured value (even if 



non-physical) and the standard error. (Separating the statistical and systematic errors, as 
is often done, is even better). In the case of a counting experiment with known background, 
the required ingredients are: the number of observed events; the expected mean background; 
and the factor (incorporating, e.g., integrated luminosity, efficiencies, etc.,) which converts 
the number of observed events to the relevant physics quantity (cross section, branching 
ratio, etc.). 

Note added in proof. Although we are not aware of previous application of this ordering 
principle to the construction of confidence intervals for the presentation of scientific results. 
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such an ordering is naturally implied by the theory of likelihood ratio tests, as explained in 
Sec. 23.1 of Ref. [10]. We thank H. Chernoff for clarifying discussions on this point. 
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FIG. 1. A generic confidence belt construction and its use. For each value of fi, one draws 
a horizontal acceptance interval [a;i,a;2] such that P{x G [xi,X2] l/i) = a- Upon performing an 
experiment to measure x and obtaining the value xq, one draws the dashed vertical line through 
xq. The confidence interval [fii,fi2] is the union of all values of /x for which the corresponding 
acceptance interval is intercepted by the vertical line. 
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FIG. 2. Standard confidence belt for 90% C.L. upper limits for the mean of a Gaussian, in 
units of the rms deviation. The second line in the belt is at a; = +oo. 
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FIG. 3. Standard confidence belt for 90% C.L. central confidence intervals for the mean of a 
Gaussian, in units of the rms deviation. 
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FIG. 4. Plot of confidence belts implicitly used for 90% C.L. confidence intervals (vertical 
intervals between the belts) quoted by flip-flopping Physicist X, described in the text. They are 
not valid confidence belts, since they can cover the true value at a frequency less than the stated 
confidence level. For 1.36 < fj, < 4.28, the coverage (probability contained in the horizontal 
acceptance interval) is 85%. 
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FIG. 5. Standard confidence belt for 90% C.L. upper limits, for unknown Poisson signal mean 
H in the presence of Poisson background with known mean b = 3.0. The second line in the belt is 
at n = +00. 
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FIG. 6. Standard confidence belt for 90% C.L. central confidence intervals, for unknown Poisson 
signal mean fj, in the presence of Poisson background with known mean b = 3.0. 
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FIG. 7. Confidence belt based on our ordering principle, for 90% C.L. confidence intervals for 
unknown Poisson signal mean ji in the presence of Poisson background with known mean 6 = 3.0. 
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FIG. 8. Upper end /X2 of our 90% C.L. confidence intervals [//i, /X2], for unknown Poisson signal 
mean fi in the presence of expected Poisson background with known mean b. The curves for the 
cases no from through 10 are plotted. Dotted portions on the upper left indicate regions where 
fii is non-zero (and shown in the following figure). Dashed portions in the lower right indicate 
regions where the probability of obtaining the number of events observed or fewer is less than 1%, 
even if = 0. 
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FIG. 9. Lower end fii of our 90% C.L. confidence intervals [//i, //2], for unknown Poisson signal 
mean /x in the presence of expected Poisson background with known mean b. The curves correspond 
to the dotted regions in the plots of /X2 of the previous figure, with again no = 10 for the upper 
right curve, etc. 
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FIG. 10. Plot of our 90% confidence intervals for mean of a Gaussian, constrained to be 
non- negative, described in the text. 
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FIG. 11. Calculation of the confidence region for an example of the toy model in which 
sin^(20) = 0. The 90% confidence region is the area to the left of the curve. 
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FIG. 12. Calculation of the confidence regions for an example of the toy model in which 
Am^ = 40 {eV/c^y and sin^(2^) = 0.006, as evaluated by the proposed technique and the Raster 
Scan. 
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FIG. 14. Regions of significant under- and overcoverage for the Global Scan. 
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FIG. 15. Comparision of the confidence region for an example of the toy model in which 
sin^(20) = and the sensitivity of the experiment, as defined in the text. 
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TABLES 



TABLE I. Illustrative calculations in the confidence belt construction for signal mean /x in the 
presence of known mean background b = 3.0. Here we find the acceptance interval for fj, = 0.5. 



n 


P{n\fi) 


A'best 


Pin\ fihcst) 


R 


rank 


U.L. 


central 
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0. 
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0.216 
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0.195 


0.966 


1 


V 


V 
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3. 
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0.259 
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0.017 


5. 
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0.050 
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TABLE II. Our 68.27% C.L. intervals for the Poisson signal mean /x, for total events observed 
no, for known mean background b ranging from to 5. 



0.0 
0.00, 1.29 
0.37, 2.75 
0.74, 4.25 



1.10, 
2.34, 
2.75, 
3.82, 



5.30 
6.78 
7.81 
9.28 



4.25,10.30 
5.30,11.32 
6.33,12.79 
6.78,13.81 
7.81,14.82 
8.83,16.29 
9.28,17.30 
10.30,18.32 
11.32,19.32 
12.33,20.80 
12.79,21.81 
13.81,22.82 
14.82,23.82 
15.83,25.30 



(}.r, 
0.00, 0.80 
0.00, 2.25 
0.44, 3.75 



0.80, 
1.84, 
2.25, 
3.32, 
3.75, 



4.80 
6.28 
7.31 
8.78 
9.80 



1.0 
0.00, 0.54 
0.00, 1.75 
0.14, 3.25 
0.54, 



2.0 



1.34, 
1.75, 
2.82, 
3.25. 



4.30 
5.78 
6.81 

8.28 
9.30 



4.80,10.82 
5.83,12.29 
6.28,13.31 
7.31,14.32 
8.33,15.79 
8.78,16.80 
9.80,17.82 
10.82,18.82 
11.83,20.30 
12.29,21.31 
13.31,22.32 
14.32,23.32 
15.33,24.80 



4.30,10.32 
5.33,11.79 
5.78,12.81 
6.81,13.82 
7.83,15.29 
8.28,16.30 
9.30,17.32 
10.32,18.32 
11.33,19.80 
11.79,20.81 
12.81,21.82 
13.82,22.82 
14.83,24.30 



0.00, 0.41 

0.00, 1.32 

0.00, 2.75 

0.32, 3.80 

0.91, 5.28 

1.32, 6.31 

2.32, 7.78 

2.75, 8.80 

3.80, 9.82 

4.83,11.29 

5.28,12.31 

6.31,13.32 

7.33,14.79 

7.78,15.80 

8.80,16.82 

9.82,17.82 

10.83,19.30 

11.29,20.31 

12.31,21.32 

13.32,22.32 

14.33,23.80 



0.00, 
0.00, 
0.00, 
0.00, 
0.44, 
0.97, 
1.82, 
2.25, 
3.30, 



0.41 
0.97 
2.25 
3.30 
4.78 
5.81 
7.28 
8.30 
9.32 



4.33,10.79 
4.78,11.81 
5.81,12.82 
6.83,14.29 
7.28,15.30 
8.30,16.32 
9.32,17.32 
10.33,18.80 
10.79,19.81 
11.81,20.82 
12.82,21.82 
13.83,23.30 



2.5 
0.00, 0.25 
0.00, 0.68 
0.00, 1.80 
0.00, 2.80 
0.25, 4.28 
0.68, 5.31 
1.37, 6.78 
1.80, 7.80 
2.80, 8.82 
3.83,10.29 
4.28,11.31 
5.31,12.32 
6.33,13.79 
6.78,14.80 
7.80,15.82 
8.82,16.82 
9.83,18.30 
10.29,19.31 
11.31,20.32 
12.32,21.32 
13.33,22.80 



;.o 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.45, 
1.01, 
1.41, 
2.30, 



0.25 
0.50 
1.41 
2.30 
3.78 
4.81 
6.28 
7.30 
8.32 



3.33, 9.79 

3.78,10.81 

4.81,11.82 

5.83,13.29 

6.28,14.30 

7.30,15.32 

8.32,16.32 

9.33,17.80 

9.79,18.81 

10.81,19.82 

11.82,20.82 

12.83,22.30 



■■-i.r, 
0.00, 0.21 
0.00, 0.50 
0.00, 1.09 
0.00, 1.84 
0.00, 3.28 
0.20, 4.31 



0.62, 
1.09, 
1.84, 
2.83, 



5.78 
6.80 
7.82 
9.29 



3.28,10.31 
4.31,11.32 
5.33,12.79 
5.78,13.80 
6.80,14.82 
7.82,15.82 
8.83,17.30 
9.29,18.31 
10.31,19.32 
11.32,20.32 
12.33,21.80 



1.0 
0.00, 0.21 
0.00, 0.36 
0.00, 0.81 
0.00, 1.45 
0.00, 2.78 
0.00, 3.81 
0.36, 5.28 



0.81, 
1.45, 
2.33, 
2.78, 



6.30 
7.32 
8.79 
9.81 



3.81,10.82 
4.83,12.29 
5.28,13.30 
6.30,14.32 
7.32,15.32 
8.33,16.80 
8.79,17.81 
9.81,18.82 
10.82,19.82 
11.83,21.30 



5.0 
0.00, 0.19 
0.00, 0.30 
0.00, 0.47 
0.00, 0.91 
0.00, 1.90 
0.00, 2.81 
0.00, 4.28 
0.32, 5.30 
0.82, 6.32 
1.44, 7.79 
1.90, 8.81 
2.81, 9.82 
3.83,11.29 
4.28,12.30 
5.30,13.32 
6.32,14.32 
7.33,15.80 
7.79,16.81 
8.81,17.82 
9.82,18.82 
10.83,20.30 



TABLE III. 68.27% C.L. intervals for the Poisson signal mean ji, for total events observed no, 

for known mean background h ranging from 6 to L5. 



no\b 


6.0 




7.0 





0.00, 0.18 





00, 0.17 


1 


0.00, 0.21 





00, 0.21 


2 


0.00, 0.31 





00, 0.27 


3 


0.00, 0.69 





00, 0.42 


4 


0.00, 1.22 





00, 0.69 


5 


0.00, 1.92 





00, 1.23 


6 


0.00, 3.28 





00, 2.38 


7 


0.00, 4.30 





00, 3.30 


8 


0.31, 5.32 





00, 4.32 


9 


0.69, 6.79 





27, 5.79 


10 


1.22, 7.81 





69, 6.81 


11 


1.92, 8.82 


1 


23, 7.82 


12 


2.83,10.29 


1 


94, 9.29 


13 


3.28,11.30 


2 


38,10.30 


14 


4.30,12.32 


3 


30,11.32 


15 


5.32,13.32 


4 


32,12.32 


16 


6.33,14.80 


5 


33,13.80 


17 


6.79,15.81 


5 


79,14.81 


18 


7.81,16.82 


6 


81,15.82 


19 


8.82,17.82 


7 


82.16.82 


20 


IJ.8:-!.l<).:-!() 


8 


83.18.30 



8.0 



9.0 



10.0 



11.0 



12.0 



13.0 



14.0 



15.0 



0.00, 0.17 
0.00, 0.20 
0.00, 0.23 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 



0.31 
0.60 
0.99 
1.65 
2.40 
3.32 



0.00, 4.79 
0.23, 5.81 
0.60, 6.82 
1.12, 8.29 
1.65, 9.30 
2.40,10.32 
3.32,11.32 
4.33,12.80 
4.79,13.81 
5.81,14.82 
6.82.15.82 
V.S:-!.17.:-!() 



0.00, 0.17 
0.00, 0.19 
0.00, 0.21 
0.00, 0.26 
0.00, 0.38 
0.00, 0.60 
0.00, 1.06 
0.00, 1.66 
0.00, 2.41 
0.00, 3.79 
0.00, 4.81 
0.19, 5.82 
0.60, 7.29 
1.06, 8.30 
1.66, 9.32 
2.41,10.32 
3.33,11.80 
3.79,12.81 
4.81,13.82 
5.82,14.82 
().8:-!.l().:-!0 



0.00, 0.16 
0.00, 0.18 
0.00, 0.20 
0.00, 0.23 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.12, 
0.60, 
1.07, 
1.67, 



0.30 
0.48 
0.63 
1.07 
1.67 
2.87 
3.81 
4.82 
6.29 
7.30 
8.32 
9.32 



2.43,10.80 
2.87,11.81 
3.81,12.82 

4.82,13.82 
.^).8:-!,l.^),:-!() 



0.00, 0.16 
0.00, 0.17 
0.00, 0.19 
0.00, 0.22 
0.00, 0.26 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 



0.35 
0.53 
0.88 
1.46 
2.10 
2.89 
3.82 



0.00, 5.29 
0.05, 6.30 
0.53, 7.32 
1.00, 8.32 
1.46, 9.80 
2.10,10.81 
2.89,11.82 
3.82.12.82 
l,S:-!.ll.:-!() 



0.00, 0.16 
0.00, 0.17 
0.00, 0.19 
0.00, 0.21 
0.00, 0.24 
0.00, 0.29 
0.00, 0.42 
0.00, 0.53 
0.00, 0.94 
0.00, 1.46 
0.00, 2.11 
0.00, 2.90 



0.00, 
0.00, 
0.00, 
0.53, 
0.94, 
1.46, 



4.29 
5.30 
6.32 
7.32 
8.80 
9.81 



2.11,10.82 

2.90.11.82 
:-!.S:-!.l:-!.:-!0 



0.00, 0.16 
0.00, 0.17 
0.00, 0.18 
0.00, 0.20 
0.00, 0.23 
0.00, 0.26 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.47, 
0.94, 
1.47, 



0.33 
0.47 
0.62 
0.94 
1.47 
2.12 
3.36 
4.30 
5.32 
6.32 
7.80 
8.81 
9.82 



0.00, 0.16 
0.00, 0.17 
0.00, 0.18 
0.00, 0.20 
0.00, 0.22 
0.00, 0.24 
0.00, 0.29 
0.00, 0.38 
0.00, 0.48 
0.00, 0.78 
0.00, 1.03 
0.00, 1.54 
0.00, 2.57 



2.12.10.82 
2.<)1.12.:-!() 



0.00, 
0.00, 
0.00, 
0.00, 
0.48, 
0.93, 
1.48. 



3.37 
4.32 
5.32 
6.80 
7.81 
8.82 
9.82 



0.00, 0.15 
0.00, 0.16 
0.00, 0.18 
0. 00, 0.19 
0.00, 0.21 
0.00, 0.23 
0.00, 0.26 
0.00, 0.32 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.43. 



0.43 
0.50 
0.84 
1.31 
1.89 
2.57 
3.38 
4.32 
5.80 
6.81 
7.82 



2.12.11,30 



0.84, 8.82 
1.31, 10, 30 
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TABLE IV. 90% C.L. intervals for the Poisson signal mean /x, for total events observed no, for 
known mean background b ranging from to 5. 



0.0 
0.00, 2.44 
0.11, 4.36 
0.53, 5.91 
1.10, 7.42 
1.47, 8.60 
1.84, 9.99 
2.21,11.47 
3.56,12.53 
3.96,13.99 
4.36,15.30 
5.50,16.50 
5.91,17.81 
7.01,19.00 
7.42,20.05 
8.50,21.50 
9.48,22.52 
9.99,23.99 
11.04,25.02 
11.47,26.16 
12.51,27.51 
13.55,28.52 



0.00, 1.94 

0.00, 3.86 

0.03, 5.41 

0.60, 6.92 

1.17, 8.10 

1.53, 9.49 

1.90,10.97 

3.06,12.03 

3.46,13.49 

3.86,14.80 

5.00,16.00 

5.41,17.31 

6.51,18.50 

6.92,19.55 

8.00,21.00 

8.98,22.02 

9.49,23.49 

10.54,24.52 

10.97,25.66 

12.01,27.01 

13.05,28.02 



1.0 
0.00, 1.61 
0.00, 3.36 
0.00, 4.91 
0.10, 6.42 
0.74, 7.60 
1.25, 8.99 

I. 61,10.47 
2.56,11.53 
2.96,12.99 
3.36,14.30 
4.50,15.50 
4.91,16.81 
6.01,18.00 
6.42,19.05 
7.50,20.50 
8.48,21.52 
8.99,22.99 
10.04,24.02 
10.47,25.16 

II. 51,26.51 
12.55,27.52 



0.00, 1.33 
0.00, 2.91 
0.00, 4.41 
0.00, 5.92 
0.24, 7.10 
0.93, 8.49 
1.33, 9.97 
2.09,11.03 
2.51,12.49 
2.91,13.80 
4.00,15.00 
4.41,16.31 
5.51,17.50 
5.92,18.55 
7.00,20.00 
7.98,21.02 
8.49,22.49 
9.54,23.52 
9.97,24.66 
11.01,26.01 
12.05,27.02 



2.0 
0.00, 1.26 
0.00, 2.53 
0.00, 3.91 
0.00, 5.42 
0.00, 6.60 
0.43, 7.99 
1.08, 9.47 

I. 59,10.53 
2.14,11.99 
2.53,13.30 
3.50,14.50 
3.91,15.81 
5.01,17.00 
5.42,18.05 
6.50,19.50 
7.48,20.52 
7.99,21.99 
9.04,23.02 
9.47,24.16 
10.51,25.51 

II. 55,26.52 



2.5 
0.00, 1.18 
0.00, 2.19 
0.00, 3.45 
0.00, 4.92 
0.00, 6.10 
0.00, 7.49 
0.65, 8.97 
1.18,10.03 

I. 81,11.49 
2.19,12.80 
3.04,14.00 
3.45,15.31 
4.51,16.50 
4.92,17.55 
6.00,19.00 
6.98,20.02 
7.49,21.49 
8.54,22.52 
8.97,23.66 
10.01,25.01 

II. 05,26.02 



3.0 
0.00, 1.08 
0.00, 1.88 
0.00, 3.04 
0.00, 4.42 
0.00, 5.60 
0.00, 6.99 
0.15, 8.47 
0.89, 9.53 
1.51,10.99 
1.88,12.30 
2.63,13.50 
3.04,14.81 
4.01,16.00 
4.42,17.05 
5.50,18.50 
6.48,19.52 
6.99,20.99 
8.04,22.02 
8.47,23.16 
9.51,24.51 
10.55,25.52 



0.00, 1.06 
0.00, 1.59 
0.00, 2.67 
0.00, 3.95 
0.00, 5.10 
0.00, 6.49 
0.00, 7.97 
0.39, 9.03 
1.06,10.49 
1.59,11.80 
2.27,13.00 
2.67,14.31 
3.54,15.50 
3.95,16.55 
5.00,18.00 
5.98,19.02 
6.49,20.49 
7.54,21.52 
7.97,22.66 
9.01,24.01 
10.05,25.02 



1.0 
0.00, 1.01 
0.00, 1.39 
0.00, 2.33 
0.00, 3.53 
0.00, 4.60 
0.00, 5.99 
0.00, 7.47 
0.00, 8.53 
0.66, 9.99 
1.33,11.30 
1.94,12.50 
2.33,13.81 
3.12,15.00 
3.53,16.05 
4.50,17.50 
5.48,18.52 
5.99,19.99 
7.04,21.02 
7.47,22.16 
8.51,23.51 
9.55,24.52 



5.0 
0.00, 0.98 
0.00, 1.22 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 



1.73 
2.78 
3.60 
4.99 
6.47 
7.53 



0.00, 8.99 
0.13,10.30 
1.19,11.50 
1.73,12.81 
2.38,14.00 
2.78,15.05 
3.59,16.50 
4.48,17.52 
4.99,18.99 
6.04,20.02 
6.47,21.16 
7.51,22.51 
8.55,23.52 



TABLE V. 90% C.L. intervals for the Poisson signal mean /i, for total events observed no, for 

known moan backgronnd h ranging from 6 to 1-5. 



6.0 



7.0 



8.0 



9.0 



10.0 



11.0 



12.0 



13.0 



14.0 



15.0 



0.00, 0.97 
0.00, 1.14 
0.00, 1.57 
0.00, 2.14 
0.00, 2.83 
0.00, 4.07 
0.00, 5.47 
0.00, 6.53 
0.00, 7.99 
0.00, 9.30 
0.22,10.50 
1.01,11.81 
1.57,13.00 
2.14,14.05 
2.83,15.50 
3.48,16.52 
4.07,17.99 
5.04,19.02 
5.47,20.16 
6.51,21.51 



0.00, 0.95 
0.00, 1.10 
0.00, 1.38 
0.00, 1.75 
0.00, 2.56 
0.00, 3.28 
0.00, 4.54 
0.00, 5.53 
0.00, 6.99 
0.00, 8.30 
0.00, 9.50 
0.02,10.81 
0.83,12.00 
1.50,13.05 
2.13,14.50 
2.56,15.52 
3.28,16.99 
4.11,18.02 
4.54,19.16 
5.51.20.51 
0.55.21.52 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 



0.94 
1.07 
1.27 
1.49 
1.98 
2.60 
3.73 
4.58 
5.99 



0.00, 7.30 
0.00, 8.50 
0.00, 9.81 
0.00,11.00 
0.65,12.05 
1.39,13.50 
1.98,14.52 
2.60,15.99 
3.32,17.02 
3.73,18.16 
4.58.19.51 
5.55.20.52 



0.00, 0.94 
0.00, 1.0.5 
0.00, 1.21 
0.00, 1.37 
0.00, 1.82 
0.00, 2.38 
0.00, 3.02 
0.00, 3.77 
0.00, 5.05 
0.00, 6.30 
0.00, 7.50 
0.00, 8.81 
0.00,10.00 
0.00,11.05 
0.47,12.50 
1.26,13.52 
1.82,14.99 
2.38,16.02 
3.02,17.16 
3.77,18.51 
1.55.10,52 



0.00, 0.93 
0.00, 1.03 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00,10.05 
0.00,11.50 
0.30,12.52 
1.13,13.99 
1.81,15.02 
2.40,16.16 
3.05,17.51 
:i.55,l<s.52 



1.15 
1.29 
1.57 
1.85 
2.40 
3.26 
4.22 
5.30 
6.50 
7.81 
9.00 



0.00, 0.93 
0.00, 1.01 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00,10.50 
0.00,11.52 
0.14,12.99 
0.98,14.02 
1.70,15.16 
2.21.16.51 
2, M. 17.52 



1.11 
1.24 
1.45 
1.70 
2.21 
2.81 
3.49 
4.30 
5.56 
6.81 
8.00 
9.05 



0.92 
1.00 
1.09 
1.21 
1.37 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 1.58 
0.00, 1.86 
0.00, 2.23 
0.00, 2.83 
0.00, 3.93 
0.00, 4.71 
0.00, 5.81 
0.00, 7.00 
0.00, 8.05 
0.00, 9.50 
0.00,10.52 
0.00,11.99 
0.00,13.02 
0.82,14.16 
1.58.15.51 
2.23.10.52 



0.00, 0.92 
0.00, 0.99 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 



1.08 
1.18 
1.31 
1.48 
1.67 
2.07 
2.62 
3.25 
3.95 
4.81 
6.05 
7.05 
8.50 
9.52 



0.00,10.99 
0.00,12.02 
0.00,13.16 

0.67.14.51 
1. 18.15.52 



0.00, 0.92 
0.00, 0.99 
0.00, 1.06 
0.00, 1.15 
0.00, 1.27 
0.00, 1.39 
0.00, 1.55 
0.00, 1.86 
0.00, 2.11 
0.00, 2.64 
0.00, 3.27 
0.00, 4.39 
0.00, 5.19 
0.00, 6.08 
0.00, 7.50 
0.00, 8.52 
0.00, 9.99 
0.00,11.02 
0.00,12.16 
0.00,13.51 
0.5:-!. 11,52 



0.00, 0.92 
0.00, 0.98 
0.00, 1.05 

0.00, 1.14 

0.00, 1.24 
0.00, 1.32 

0.00, 1.47 

0.00, 1.69 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 



1.95 
2.45 
3.00 
3.69 
4.42 
5.22 
6.55 
7.52 
8.99 



0.00,10.02 
0.00,11.16 

0.00,12.51 
0,00,1:-!. 52 



37 



TABLE VI. 95% C.L. intervals for the Poisson signal mean /x, for total events observed no, for 
known mean background b ranging from to 5. 



0.0 
0.00, 3.09 
0.05, 5.14 
0.36, 6.72 
0.82, 8.25 
1.37, 9.76 

I. 84,11.26 
2.21,12.75 
2.58,13.81 
2.94,15.29 
4.36,16.77 
4.75,17.82 
5.14,19.29 
6.32,20.34 
6.72,21.80 
7.84,22.94 
8.25,24.31 
9.34,25.40 
9.76,26.81 
10.84,27.84 

II. 26,29.31 
12.33,30.33 



0.5 
0.00, 2.63 
0.00, 4.64 
0.00, 6.22 
0.32, 7.75 
0.87, 9.26 
1.47,10.76 

I. 90,12.25 
2.27,13.31 
2.63,14.79 
3.86,16.27 
4.25,17.32 
4.64,18.79 
5.82,19.84 
6.22,21.30 
7.34,22.44 
7.75,23.81 
8.84,24.90 
9.26,26.31 
10.34,27.34 
10.76,28.81 

II. 83,29.83 



1.0 
0.00, 2.33 
0.00, 4.14 
0.00, 5.72 
0.00, 7.25 
0.37, 8.76 
0.97,10.26 
1.61,11.75 

I. 97,12.81 
2.33,14.29 
3.36,15.77 
3.75,16.82 
4.14,18.29 
5.32,19.34 
5.72,20.80 
6.84,21.94 
7.25,23.31 
8.34,24.40 
8.76,25.81 
9.84,26.84 
10.26,28.31 

II. 33,29.33 



2.05 
3.69 
5.22 
6.75 
8.26 
9.76 



1.5 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.47, 
1.11,11.25 
1.69,12.31 
2.05,13.79 
2.91,15.27 
3.30,16.32 
3.69,17.79 
4.82,18.84 
5.22,20.30 
6.34,21.44 
6.75,22.81 
7.84,23.90 
8.26,25.31 
9.34,26.34 
9.76,27.81 
10.83,28.83 



2.0 
0.00, 1.78 
0.00, 3.30 
0.00, 4.72 
0.00, 6.25 
0.00, 7.76 
0.00, 9.26 
0.61,10.75 
1.29,11.81 
1.78,13.29 
2.46,14.77 
2.92,15.82 
3.30,17.29 
4.32,18.34 
4.72,19.80 
5.84,20.94 
6.25,22.31 
7.34,23.40 
7.76,24.81 
8.84,25.84 
9.26,27.31 
10.33,28.33 



1.78 
2.95 
4.25 
5.75 
7.26 
8.76 



2.. 

"oooT 

0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.11,10.25 
0.79,11.31 
1.48,12.79 
1.96,14.27 
2.57,15.32 
2.95,16.79 
3.85,17.84 
4.25,19.30 
5.34,20.44 
5.75,21.81 
6.84,22.90 
7.26,24.31 
8.34,25.34 
8.76,26.81 
9.83,27.83 



:10 
0.00, 1.63 
0.00, 2.63 
0.00, 3.84 
0.00, 5.25 
0.00, 6.76 
0.00, 8.26 
0.00, 9.75 
0.29,10.81 
0.98,12.29 
1.62,13.77 
2.25,14.82 
2.63,16.29 
3.44,17.34 
3.84,18.80 
4.84,19.94 
5.25,21.31 
6.34,22.40 
6.76,23.81 
7.84,24.84 
8.26,26.31 
9.33,27.33 



0.00, 1.63 
0.00, 2.33 
0.00, 3.46 
0.00, 4.78 
0.00, 6.26 
0.00, 7.76 
0.00, 9.25 
0.00,10.31 
0.48,11.79 
1.20,13.27 
1.82,14.32 
2.33,15.79 
3.06,16.84 
3.46,18.30 
4.37,19.44 
4.78,20.81 
5.84,21.90 
6.26,23.31 
7.34,24.34 
7.76,25.81 
8.83,26.83 



1.0 
0.00, 1.57 
0.00, 2.08 
0.00, 3.11 
0.00, 4.35 
0.00, 5.76 
0.00, 7.26 
0.00, 8.75 
0.00, 9.81 
0.00,11.29 
0.70,12.77 
1.43,13.82 
2.04,15.29 
2.69,16.34 
3.11,17.80 
3.94,18.94 
4.35,20.31 
5.34,21.40 
5.76,22.81 
6.84,23.84 
7.26,25.31 
8.33,26.33 



5.0 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
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1 

1.88 
2.49 
3.58 
4.84 
6.26 
7.75 
8.81 



0.00,10.29 
0.00,11.77 
0.43,12.82 
1.17,14.29 
1.88,15.34 
2.47,16.80 
3.10,17.94 
3.58,19.31 
4.43,20.40 
4.84,21.81 
5.84,22.84 
6.26,24.31 
7.33,25.33 



TABLE VII. 95% C.L. intervals for the Poisson signal mean /x, for total events observed no, 

for known mean background b ranging from 6 to 15. 



6.0 



7.0 



8.0 



9.0 



10.0 



11.0 



12.0 



13.0 



14.0 



15.0 



0.00, 1.52 
0.00, 1.78 
0.00, 2.28 
0.00, 2.91 
0.00, 4.05 
0.00, 5.33 
0.00, 6.75 
0.00, 7.81 
0.00, 9.29 
0.00,10.77 
0.00,11.82 
0.17,13.29 
0.92,14.34 
1.68,15.80 
2.28,16.94 
2.91,18.31 
3.60,19.40 
4.05,20.81 
4.91,21.84 
5. .33, 23. 31 
().33.2i.33 



0.00, 1.51 
0.00, 1.73 
0.00, 2.11 
0.00, 2.69 
0.00, 3.35 
0.00, 4.52 
0.00, 5.82 
0.00, 6.81 
0.00, 8.29 
0.00, 9.77 
0.00,10.82 
0.00,12.29 
0.00,13.34 
0.69,14.80 
1.46,15.94 
2.11,17.31 
2.69,18.40 
3.35,19.81 
4.11,20.84 
4.52.22.31 
5. 31). 23. 33 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 



1.50 
1.69 
1.98 
2.37 
3.01 
3.79 



0.00, 4.99 
0.00, 5.87 
0.00, 7.29 
0.00, 8.77 
0.00, 9.82 
0.00,11.29 
0.00,12.34 
0.00,13.80 
0.46,14.94 
1.25,16.31 
1.98,17.10 
2.63,18.81 
3.18,19.84 
3.79.21.31 
1.57.22.33 



0.00, 1.49 

0.00, 1.66 
0.00, 1.86 
0.00, 2.17 
0.00, 2.54 
0.00, 3.15 
0.00, 4.24 
0.00, 5.03 
0.00, 6.35 
0.00, 7.77 
0.00, 8.82 
0.00,10.29 
0.00,11.34 
0.00,12.80 
0.00,13.94 
0.25,15.31 
1.04,16.40 
1.83,17.81 
2.53,18.84 
3.15,20.31 
3.82.21,3:i 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00,10.34 
0.00,11.80 
0.00,12.94 
0.00,14.31 
0.04,15.40 
0.83,16.81 
1.63,17.84 
2.37,19.31 
2.91,20.33 



1.49 
1.64 
1.81 
2.06 
2.37 
2.94 
3.57 
4.28 
5.50 
6.82 
7.82 
9.29 



1.48 
1.61 
1.77 
1.98 
2.23 
2.65 
3.14 
4.00 
4.73 
5.96 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 6.87 
0.00, 8.29 
0.00, 9.34 
0.00,10.80 
0.00,11.94 
0.00,13.31 
0.00,14.40 
0.00,15.81 
0.63,16.84 
1.44.18.31 
2,23.19.33 



0.00, 1.48 

0.00, 1.60 

0.00, 1.74 

0.00, 1.93 
0.00, 2.11 
0.00, 2.43 
0.00, 2.78 
0.00, 3.37 
0.00, 4.03 
0.00, 5.18 
0.00, 6.00 
0.00, 7.34 
0.00, 8.34 
0.00, 9.80 
0.00,10.94 
0.00,12.31 
0.00,13.40 
0.00,14.81 
0.00,15.84 
0.44,17,31 
1,25,18,33 



0.00, 1.48 

0.00, 1.59 

0.00, 1.72 

0.00, 1.89 

0.00, 2.04 

0.00, 2.30 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 



2.62 
3.15 
3.79 
4.47 
5.21 
6.47 
7.37 
8.80 
9.94 



0.00,11.31 
0.00,12.40 
0.00,13.81 
0.00,14.84 
0.00,16,31 
0.25.17.33 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 



1.47 
1.58 
1.70 
1.82 
1.99 



0.00, 2.20 
0.00, 2.48 
0.00, 2.79 
0.00, 3.20 
0.00, 3.81 
0.00, 4.59 
0.00, 5.67 
0.00, 6.50 
0.00, 7.85 
0.00, 8.94 
0.00,10.31 
0.00,11.40 
0.00,12.81 
0.00,13.84 
0.00,15.31 
0,00,1(),33 



0.00, 1.47 

0.00, 1.56 

0.00, 1.67 

0.00, 1.80 

0.00, 1.95 

0.00, 2.13 

0.00, 2.35 

0.00, 2.59 



0.00, 
0.00, 
0.00, 
0.00, 

0.00, 
0.00, 
0.00, 
0.00, 



3.02 
3.60 
4.24 
4.93 
5.70 
6.96 
7.94 
9.31 



0.00,10.40 
0.00,11.81 
0.00,12.84 
0,00,14,31 
0,00,15,33 
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TABLE VIII. 99% C.L. intervals for the Poisson signal mean /x, for total events observed no, 
for known mean background b ranging from to 5. 



0.0 
0.00, 4.74 
0.01, 6.91 
0.15, 8.71 
0.44,10.47 
0.82,12.23 
1.28,13.75 
1.79,15.27 
2.33,16.77 
2.91,18.27 
3.31,19.46 
3.68,20.83 
4.05,22.31 
4.41,23.80 
5.83,24.92 
6.31,26.33 
6.70,27.81 
7.76,28.85 
8.32,30.33 
8.71,31.81 
9.88,32.85 
10.28,34.32 



0.5 
0.00, 4.24 
0.00, 6.41 
0.00, 8.21 
0.00, 9.97 
0.32,11.73 
0.78,13.25 
1.29,14.77 
1.83,16.27 
2.41,17.77 
3.00,18.96 
3.37,20.33 
3.73,21.81 
4.10,23.30 
5.33,24.42 
5.81,25.83 
6.20,27.31 
7.26,28.35 
7.82,29.83 
8.21,31.31 
9.38,32.35 
9.78,33.82 



1.0 
0.00, 3.80 
0.00, 5.91 
0.00, 7.71 
0.00, 9.47 
0.00,11.23 
0.28,12.75 
0.79,14.27 
1.33,15.77 
1.91,17.27 
2.51,18.46 
3.07,19.83 
3.43,21.31 
3.80,22.80 
4.83,23.92 
5.31,25.33 
5.70,26.81 
6.76,27.85 
7.32,29.33 
7.71,30.81 
8.88,31.85 
9.28,33.32 



1.5 
0.00, 3.50 
0.00, 5.41 
0.00, 7.21 
0.00, 8.97 
0.00,10.73 
0.00,12.25 
0.29,13.77 
0.83,15.27 
1.41,16.77 
2.01,17.96 
2.63,19.33 
3.14,20.81 
3.50,22.30 
4.33,23.42 
4.86,24.83 
5.24,26.31 
6.26,27.35 
6.82,28.83 
7.21,30.31 
8.38,31.35 
8.78,32.82 



2.0 
0.00, 3.26 
0.00, 4.91 
0.00, 6.71 
0.00, 8.47 
0.00,10.23 
0.00,11.75 
0.00,13.27 
0.33,14.77 
0.91,16.27 
1.51,17.46 
2.13,18.83 
2.77,20.31 
3.22,21.80 
3.83,22.92 
4.46,24.33 
4.84,25.81 
5.76,26.85 
6.32,28.33 
6.71,29.81 
7.88,30.85 
8.28,32.32 



2.r, 
0.00, 3.26 
0.00, 4.48 
0.00, 6.24 
0.00, 7.97 
0.00, 9.73 
0.00,11.25 
0.00,12.77 
0.00,14.27 
0.41,15.77 
1.01,16.96 
1.63,18.33 
2.27,19.81 
2.93,21.30 
3.33,22.42 
4.10,23.83 
4.48,25.31 
5.26,26.35 
5.85,27.83 
6.24,29.31 
7.38,30.35 
7.78,31.82 



:10 
0.00, 3.05 
0.00, 4.14 
0.00, 5.82 
0.00, 7.47 
0.00, 9.23 
0.00,10.75 
0.00,12.27 
0.00,13.77 
0.00,15.27 
0.51,16.46 
1.13,17.83 
1.77,19.31 
2.43,20.80 
3.02,21.92 
3.67,23.33 
4.14,24.81 
4.76,25.85 
5.42,27.33 
5.82,28.81 
6.88,29.85 
7.28,31.32 



1.0 



0.00, 3.05 
0.00, 4.09 
0.00, 5.42 
0.00, 6.97 
0.00, 8.73 
0.00,10.25 
0.00,11.77 
0.00,13.27 
0.00,14.77 
0.01,15.96 
0.63,17.33 
1.27,18.81 
1.93,20.30 
2.60,21.42 
3.17,22.83 
3.82,24.31 
4.26,25.35 
5.03,26.83 
5.42,28.31 
6.40,29.35 
6.81,30.82 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 



2.98 
3.89 
5.06 
6.47 
8.23 
9.75 



0.00,11.27 
0.00,12.77 
0.00,14.27 
0.00,15.46 
0.13,16.83 
0.77,18.31 
1.43,19.80 
2.10,20.92 
2.78,22.33 
3.42,23.81 
3.89,24.85 
4.67,26.33 
5.06,27.81 
5.97,28.85 
6.37,30.32 



5.0 
0.00, 2.94 
0.00, 3.59 
0.00, 4.37 
0.00, 5.57 
0.00, 7.30 
0.00, 8.75 
0.00,10.27 
0.00,11.77 
0.00,13.27 
0.00,14.46 
0.00,15.83 
0.00,17.31 
0.43,18.80 
1.10,19.92 
1.78,21.33 
2.48,22.81 
3.15,23.85 
3.73,25.33 
4.37,26.81 
5.01,27.85 
5.57,29.32 



TABLE IX. 99% C.L. intervals for the Poisson signal mean /x, for total events observed no, for 

known moan backgronnd b ranging from 6 to 1-5. 



6.0 



7.0 



8.0 



9.0 



10.0 



11.0 



12.0 



13.0 



14.0 



15.0 



0.00, 2.91 
0.00, 3.42 
0.00, 4.13 
0.00, 5.25 
0.00, 6.47 
0.00, 7.81 
0.00, 9.27 
0.00,10.77 
0.00,12.27 
0.00,13.46 
0.00,14.83 
0.00,16.31 
0.00,17.80 
0.10,18.92 
0.78,20.33 
1.48,21.81 
2.18,22.85 
2.89,24.33 
3.53,25.81 
1.13,26.85 
1.8().2S.:-!2 



0.00, 2.90 
0.00, 3.31 
0.00, 3.89 
0.00, 4.59 
0.00, 5.73 
0.00, 6.97 
0.00, 8.32 
0.00, 9.77 
0.00,11.27 
0.00,12.46 
0.00,13.83 
0.00,15.31 
0.00,16.80 
0.00,17.92 
0.00,19.33 
0.48,20.81 
1.18,21.85 
1.89,23.33 
2.62,24.81 
3.31.25.85 
:-!.<):-!. 27.:-!2 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 



2.89 
3.21 
3.70 
4.35 
5.04 
6.21 



0.00, 7.47 
0.00, 8.82 
0.00,10.27 
0.00,11.46 
0.00,12.83 
0.00,14.31 
0.00,15.80 
0.00,16.92 
0.00,18.33 
0.00,19.81 
0.18,20.85 
0.89,22.33 
1.62,23.81 
2.35.24.85 
:-!.08.2().:-!2 



0.00, 2.88 
0.00, 3.18 
0.00, 3.56 
0.00, 4.06 
0.00, 4.79 
0.00, 5.50 
0.00, 6.68 
0.00, 7.95 
0.00, 9.31 
0.00,10.46 
0.00,11.83 
0.00,13.31 
0.00,14.80 
0.00,15.92 
0.00,17.33 
0.00,18.81 
0.00,19.85 
0.00,21.33 
0.62,22.81 
1.35,23.85 
2. OS. 25. 32 



0.00, 2.88 
0.00, 3.1.5 
0.00, 3.44 
0.00, 3.89 



4.39 
5.17 
5.96 
7.16 
8.44 
9.46 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00,10.83 
0.00,12.31 
0.00,13.80 
0.00,14.92 
0.00,16.33 
0.00,17.81 
0.00,18.85 
0.00,20.33 
0.00,21.81 
0.35,22.85 
1.0<s,2i.:-!2 



0.00, 2.87 
0.00, 3.11 
0.00, 3.39 
0.00, 3.77 
0.00, 4.17 
0.00, 4.67 
0.00, 5.46 
0.00, 6.42 
0.00, 7.63 
0.00, 8.50 
0.00, 9.87 
0.00,11.31 
0.00,12.80 
0.00,13.92 
0.00,15.33 
0.00,16.81 
0.00,17.85 
0.00,19.33 
0.00,20.81 
0.00.21.85 
().08.2:-!.:-!2 



0.00, 2.87 
0.00, 3.09 
0.00, 3.35 
0.00, 3.65 
0.00, 4.02 
0.00, 4.42 
0.00, 5.05 
0.00, 5.73 
0.00, 6.88 
0.00, 7.69 
0.00, 8.98 
0.00,10.35 
0.00,11.80 
0.00,12.92 
0.00,14.33 
0.00,15.81 
0.00,16.85 
0.00,18.33 
0.00,19.81 
0.00.20.85 
0.00.22.32 



0.00, 2.86 
0.00, 3.07 
0.00, 3.32 
0.00, 3.56 
0.00, 3.91 
0.00, 4.24 



0.00, 
0.00, 
0.00, 
0.00, 
0.00, 
0.00, 



4.83 
5.48 
6.18 
7.34 
8.16 
9.46 



0.00,10.83 
0.00,11.92 
0.00,13.33 
0.00,14.81 
0.00,15.85 
0.00,17.33 
0.00,18.81 
0.00.19.85 
0.00.21.:-!2 



0.00, 2.86 
0.00, 3.06 
0.00, 3.26 
0.00, 3.51 
0.00, 3.82 
0.00, 4.11 
0.00, 4.63 
0.00, 5.12 
0.00, 5.83 
0.00, 6.62 
0.00, 7.39 
0.00, 8.63 
0.00, 9.94 
0.00,10.92 
0.00,12.33 
0.00,13.81 
0.00,14.85 
0.00,16.33 
0.00,17.81 
0.00,18.85 
0.00.20.:-!2 



0.00, 2.86 
0.00, 3.03 
0.00, 3.23 

0.00, 3.47 
0.00, 3.74 
0.00, 4.01 
0.00, 4.44 

0.00, 4.82 



5.29 
5.95 
7.07 
7.84 
9.09 
9.98 



0.00, 
0.00, 
0.00, 
0.00, 

0.00, 
0.00, 
0.00,11.36 
0.00,12.81 
0.00,13.85 
0.00,15.33 
0.00,16.81 
0.00,17.85 
0,00, 19. 32 
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TABLE X. Our confidence intervals for the mean of a Gaussian, constrained to be 
non- negative, as a function of the measured mean xq, for commonly used confidence levels. Ital- 
icized intervals corresponds to cases where the goodness-of-fit probability (Sec. IV C ) is less than 
1%. All numbers are in units of a. 



Xo 


68.27% C.L. 


90% C.L. 


95% C.L. 


99% C.L. 


-3.0 


0.00, 0.04 


0.00, 0.26 


0.00, 0.42 


0.00, 0.80 


-2.9 


0.00, 0.04 


0.00, 0.27 


0.00, 0.44 


0.00, 0.82 


-2.8 


0.00, 0.04 


0.00, 0.28 


0.00, 0.45 


0.00, 0.84 


-2.7 


0.00, 0.04 


0.00, 0.29 


0.00, 0.47 


0.00, 0.87 


-2.6 


0.00, 0.05 


0.00, 0.30 


0.00, 0.48 


0.00, 0.89 


-2.5 


0.00, 0.05 


0.00, 0.32 


0.00, 0.50 


0.00, 0.92 


-2.4 


0.00, 0.05 


0.00, 0.33 


0.00, 0.52 


0.00, 0.95 


-2.3 


0.00, 0.05 


0.00, 0.34 


0.00, 0.54 


0.00, 0.99 


-2.2 


0.00, 0.06 


0.00, 0.36 


0.00, 0.56 


0.00, 1.02 


-2.1 


0.00, 0.06 


0.00, 0.38 


0.00, 0.59 


0.00, 1.06 


-2.0 


0.00, 0.07 


0.00, 0.40 


0.00, 0.62 


0.00, 1.10 


-1.9 


0.00, 0.08 


0.00, 0.43 


0.00, 0.65 


0.00, 1.14 


-1.8 


0.00, 0.09 


0.00, 0.45 


0.00, 0.68 


0.00, 1.19 


-1.7 


0.00, 0.10 


0.00, 0.48 


0.00, 0.72 


0.00, 1.24 


-1.6 


0.00, 0.11 


0.00, 0.52 


0.00, 0.76 


0.00, 1.29 


-1.5 


0.00, 0.13 


0.00, 0.56 


0.00, 0.81 


0.00, 1.35 


-1.4 


0.00, 0.15 


0.00, 0.60 


0.00, 0.86 


0.00, 1.41 


-1.3 


0.00, 0.17 


0.00, 0.64 


0.00, 0.91 


0.00, 1.47 


-1.2 


0.00, 0.20 


0.00, 0.70 


0.00, 0.97 


0.00, 1.54 


-1.1 


0.00, 0.23 


0.00, 0.75 


0.00, 1.04 


0.00, 1.61 


-1.0 


0.00, 0.27 


0.00, 0.81 


0.00, 1.10 


0.00, 1.68 


-0.9 


0.00, 0.32 


0.00, 0.88 


0.00, 1.17 


0.00, 1.76 


-0.8 


0.00, 0.37 


0.00, 0.95 


0.00, 1.25 


0.00, 1.84 


-0.7 


0.00, 0.43 


0.00, 1.02 


0.00, 1.33 


0.00, 1.93 


-0.6 


0.00, 0.49 


0.00, 1.10 


0.00, 1.41 


0.00, 2.01 


-0.5 


0.00, 0.56 


0.00, 1.18 


0.00, 1.49 


0.00, 2.10 


-0.4 


0.00, 0.64 


0.00, 1.27 


0.00, 1.58 


0.00, 2.19 


-0.3 


0.00, 0.72 


0.00, 1.36 


0.00, 1.67 


0.00, 2.28 


-0.2 


0.00, 0.81 


0.00, 1.45 


0.00, 1.77 


0.00, 2.38 


-0.1 


0.00, 0.90 


0.00, 1.55 


0.00, 1.86 


0.00, 2.48 


0.0 


0.00, 1.00 


0.00, 1.64 


0.00, 1.96 


0.00, 2.58 


0.1 


0.00, 1.10 


0.00, 1.74 


0.00, 2.06 


0.00, 2.68 


0.2 


0.00, 1.20 


0.00, 1.84 


0.00, 2.16 


0.00, 2.78 


0.3 


0.00, 1.30 


0.00, 1.94 


0.00, 2.26 


0.00, 2.88 


0.4 


0.00, 1.40 


0.00, 2.04 


0.00, 2.36 


0.00, 2.98 


0.5 


0.02, 1.50 


0.00, 2.14 


0.00, 2.46 


0.00, 3.08 


0.6 


0.07, 1.60 


0.00, 2.24 


0.00, 2.56 


0.00, 3.18 


0.7 


0.11, 1.70 


0.00, 2.34 


0.00, 2.66 


0.00, 3.28 


0.8 


0.15, 1.80 


0.00, 2.44 


0.00, 2.76 


0.00, 3.38 


0.9 


0.19, 1.90 


0.00, 2.54 


0.00, 2.86 


0.00, 3.48 


1.0 


0.24, 2.00 


0.00, 2.64 


0.00, 2.96 


0.00, 3.58 


1.1 


0.30, 2.10 


0.00, 2.74 


0.00, 3.06 


0.00, 3.68 


1.2 


0.35, 2.20 


0.00, 2.84 


0.00, 3.16 


0.00, 3.78 


1.3 


0.42, 2.30 


0.02, 2.94 


0.00, 3.26 


0.00, 3.88 


1.4 


0.49, 2.40 


0.12, 3.04 


0.00, 3.36 


0.00, 3.98 


1.5 


0.56, 2.50 


0.22, 3.14 


0.00, 3.46 


0.00, 4.08 


1.6 


0.64, 2.60 


0.31, 3.24 


0.00, 3.56 


0.00, 4.18 


1.7 


0.72, 2.70 


0.38, 3.34 


0.06, 3.66 


0.00, 4.28 


1.8 


0.81, 2.80 


0.45, 3.44 


0.16, 3.76 


0.00, 4.38 


1.9 


0.90, 2.90 


0.51, 3.54 


0.26, 3.86 


0.00, 4.48 


2.0 


1.00, 3.00 


0.58, 3.64 


0.35, 3.96 


0.00, 4.58 


2.1 


1.10, 3.10 


0.65, 3.74 


0.45, 4.06 


0.00, 4.68 


2.2 


1.20, 3.20 


0.72, 3.84 


0.53, 4.16 


0.00, 4.78 


2.3 


1.30, 3.30 


0.79, 3.94 


0.61, 4.26 


0.00, 4.88 


2.4 


1.40, 3.40 


0.87, 4.04 


0.69, 4.36 


0.07, 4.98 


2.5 


1.50, 3.50 


0.95, 4.14 


0.76, 4.46 


0.17, 5.08 


2.6 


1.60, 3.60 


1.02, 4.24 


0.84, 4.56 


0.27, 5.18 


2.7 


1.70, 3.70 


1.11, 4.34 


0.91, 4.66 


0.37, 5.28 


2.8 


1.80, 3.80 


1.19, 4.44 


0.99, 4.76 


0.47, 5.38 


2.9 


1.90, 3.90 


1.28, 4.54 


1.06, 4.86 


0.57, 5.48 


3.0 


2.00, 4.00 


1.37, 4.64 


1.14, 4.96 


0.67, 5.58 
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3.1 2.10, 4.10 1.46, 4.74 1.22, 5.06 0.77, 5.68 



TABLE XL Properties of the proposed technique for setting confidence regions in neutrino 
oscillation search experiments and three alternative classical techniques defined in the text. 



Technique 


Always 
gives useful 
results 


Gives 

proper 

coverage 


Is powerful 


Raster Scan 








Flip-Flop Raster Scan 








Global Scan 








Proposed Technique 









TABLE XIL Experimental sensitivity (defined as the average upper limit that would be ob- 
tained by an ensemble of experiments with the expected background and no true signal), as a 
function of the expected background, for the case of a measurement of a Poisson variable. 



6 


68.27% C.L. 


90% C.L. 


95% C.L. 


99% C.L. 


0.0 


1.29 


2.44 


3.09 


4.74 


0.5 


1.52 


2.86 


3.59 


5.28 


1.0 


1.82 


3.28 


4.05 


5.79 


1.5 


2.07 


3.62 


4.43 


6.27 


2.0 


2.29 


3.94 


4.76 


6.69 


2.5 


2.45 


4.20 


5.08 


7.11 


3.0 


2.62 


4.42 


5.36 


7.49 


3.5 


2.78 


4.63 


5.62 


7.87 


4.0 


2.91 


4.83 


5.86 


8.18 


5.0 


3.18 


5.18 


6.32 


8.76 


6.0 


3.43 


5.53 


6.75 


9.35 


7.0 


3.63 


5.90 


7.14 


9.82 


8.0 


3.86 


6.18 


7.49 


10.27 


9.0 


4.03 


6.49 


7.81 


10.69 


10.0 


4.20 


6.76 


8.13 


11.09 


11.0 


4.42 


7.02 


8.45 


11.46 


12.0 


4.56 


7.28 


8.72 


11.83 


13.0 


4.71 


7.51 


9.01 


12.22 


14.0 


4.87 


7.75 


9.27 


12.56 


15.0 


5.03 


7.99 


9.54 


12.90 
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